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FIELD OF THE INVENTION 

[0001] The present invention relates to microprocessor 
systems, and more particularly to allocating processor cycles in 
a block multithreaded processor. 

BACKGROUND OF THE INVENTION 

[0002] In multithreaded processors, the processor holds the 
state of several active threads, which can be executed 
independently. When one of the threads becomes blocked, for 
example due to a cache miss, another thread can be executed so 
that processor cycles are not wasted. If thread switching were 
only performed due to a thread becoming blocked, the percentage 
of processor cycles allotted to each thread would be nearly 
impossible to predict. Furthermore, the maximum time between 
activation of a thread would also be nearly impossible to 
predict . 

[0003] Conventional thread switching units have been 
implemented using timer interrupts and progress -monitoring 
software in a real-time kernel. In general, the progress- 
monitoring software can dynamically reconfigure the thread 
mappings as necessary to maintain the required net allocation of 
processor cycles to the threads. However, this approach adds 
software complexity and runtime overhead. Furthermore, the 
runtime overhead limits the granularity of control that can be 
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obtained by the progress monitoring software. Specifically, as 
the interrupt timers are set to smaller intervals, the system 
would spend more time responding to interrupts than actually 
processing the threads. 

[0004] Hence there is a need for a method or system to control 
the thread switching in multithreaded processors so that the 
percentages of processors cycles can be allotted to the threads 
without undue overhead reducing the amount of processor cycles 
that can be allotted to the threads. 

SUMMARY 

[0005] Accordingly, a multithreaded processor in accordance 
with the present invention implements thread switching in 
hardware to remove the software overhead of conventional thread 
switching systems. Furthermore, the present invention includes a 
novel thread allocation method of selecting a priority thread and 
executing the priority thread if the priority thread is not 
blocked. In general the priority thread is selected 
independently from thread execution. In one embodiment of the 
present invention, a set of "maxtime" registers control the 
maximum number of cycles a thread remains the "priority thread" . 
[0006] In one embodiment of the present invention the thread 

selection unit includes a priority thread selector configured to 
generate a priority thread value associated with a priority 
thread and an execution thread selector coupled to receive the 
priority thread value and to generate an execution thread value 
associated with an execution thread. If the priority thread is 
not blocked, the execution thread value is set equal to the 
priority thread value so that the priority thread is executed by 
the execution unit. However, if the priority thread is blocked, 
the execution thread value is set to another value so that 
another thread can be executed. The priority thread selector 
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includes a maxtime register for each active thread, a priority- 
thread counter, a comparator and a counter. The priority thread 
counter provides the priority thread value. The maxtime value of 
each thread is the number of cycles a particular thread can 
remain the priority thread before another thread is selected as 
the priority thread. The counter counts the number of cycles 
since the current priority thread first became the priority 
thread. The comparator compares the count value from the counter 
with the maxtime value associated with the priority thread, when 
the count value matches the maxtime value the counter is reset 
and the priority thread counter is incremented. 

[0007] The present invention will be more fully understood in 
view of the following description and drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0008] Fig. 1(a) is simplified block diagram of a thread 
selection unit in accordance with one embodiment of the present 
invention. 

[0009] Fig. 2 is simplified block diagram of a priority thread 
selector in accordance with one embodiment of the present 
invention. 

[0010] Fig. 3 is a simplified block diagram of a priority 
thread selector in accordance with another embodiment of the 
present invent ion . 

[0011] Fig. 4 is a simplified block diagram of a execution 
thread selector in accordance with one embodiment of the present 
invention. 

[0012] Fig. 5 is a state diagram for a state machine in 
accordance with one embodiment of the present invention. 
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DETAILED DESCRIPTION 

[0013] As explained above, conventional multithreaded 
processors use timer interrupts and progress monitoring software 
to control thread switching. The software overhead associated 
with conventional methods is eliminated with the present 
invention. 

[0014] In general, a multithreaded processor can have a 
maximum number of active threads. A priority thread PT and an 
execution thread ET are selected from among the active threads. 
For clarity, the embodiments described herein are capable of 
supporting N active threads numbered from 0 to N-l, and are 
referred to as thread 0, thread 1, ... thread N-l. Priority thread 
PT and execution thread ET refer to one of the active thread. For 
clarity a priority thread value PTV is used herein to refer to 
priority thread PT. Priority thread value PTV is an integer 
value between 0 and N-l, inclusive. Thus, priority thread PT is 
the same as thread PTV. Similarly, an execution thread value ETV 
is used herein to refer to execution thread ET. Execution thread 
value ETV is an integer value between 0 and N-l, inclusive. 
Thus, execution thread ET is the same as thread ETV. 
[0015] Fig. 1 is a simplified block diagram of a thread 
selection unit 100 in accordance with one embodiment of the 
present invention. Thread selection unit 100 includes a 
priority thread selector 110 and an execution thread selector 
120. Priority thread selector 110 selects a priority thread PT 
for execution thread selector 120. Specifically, priority thread 
selector provides priority thread value PTV to execution thread 
selector 120. Execution thread selector 120 selects an execution 
thread ET, which is executed by the execution unit (not shown) 
based on the status of priority thread PT and the other threads. 
Specifically, if priority thread PT is not blocked, priority 
thread PT is selected as execution thread ET. However, if 
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priority thread PT is blocked, execution thread selector 120 
selects a non-priority thread as execution thread ET. Execution 
thread selector 120 generates execution thread value ETV to 
indicate which thread is the execution thread. 
[0016] Priority thread selector 110 is used to control the 
allocation of processor cycles among the threads. Fig. 2 is a 
simplified block diagram of a priority thread selector 200 in 
accordance with one embodiment of the present invention. 
Priority thread selector 2 00 includes a priority thread counter 
210, a set of maxtime registers 220, a counter 230, and a 
comparator 240. Priority thread counter 210 is a modulo N 
counter and provides priority thread value PTV to maxtime 
registers 220 and execution thread selector 120 (Fig. 1) . 
Comparator 24 0 increments priority thread counter 210 to change 
the priority thread as described below. 

[0017] Maxtime registers 220 includes one register for each 
active thread. Therefore, maxtime registers 220 includes N 
independent registers. For clarity, each maxtime register is 
referred to using the notation maxtime register MT_REG [X] , where 
X is an integer from 0 to (N-l) , inclusive. Maxtime register 
MT_REG [X] is associated with thread X. Furthermore, the content 
of maxtime register MT__REG [X] , is referred using the notation 
maxtime value MAXTIME [X] . Maxtime registers 220 provides maxtime 
value MAXTIME [PTV] i.e. the contents of maxtime register 
MT_REG[PTV] which is associated with thread PTV (priority thread 
PT) . The content of the maxtime register determines how long the 
associated thread can remain the priority thread as explained 
below. 

[0018] Counter 230 simply counts up from zero and provides a 
count value COUNT to comparator 240. Counter 230 can be reset 
via reset signal RESET from comparator 240. Comparator 240 
compares maxtime value MAXTIME [PTV] with count value COUNT. If 
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maxtime value MAXTIME [PT] is equal to COUNT, comparator 240 
resets counter 230 and increments priority thread counter 210. 
[0019] Thus, each thread X is selected as priority thread PT 
for maxtime value MAXTIME [x] cycles. By controlling the maxtime 
values associated with each active thread the processor cycles 
can be distributed between the active threads as desired. 
Specifically, thread X is selected as priority thread PT for 
100*MAXTIME [X] /TOTAL__MT percent of the time, where T0TAL_MT is 
the sum of the N maxtime registers. For example in a system with 
4 active threads where the processor cycle allocation should be 
10%, 35%, 25%, and 30%, maxtime values MAXTIME [0] , MAXTIME [1] , 
MAXTIME [2] , and MAXTIME [3 ] can be assigned values 10, 35, 25, and 
3 0 respectively. Alternatively the set of maxtime values can be 
assigned other values in the same ratio such as 4, 14, 10, and 
12. 

[0020] Another benefit of the present invention, is that the 
interval between the time that thread X is no longer selected as 
priority thread PT and the time thread X is again selected as 
priority thread PT can be predetermined with the selection of the 
maxtime values. Specifically, after thread X is no longer 
priority thread PT, thread X will become priority thread PT again 
within TOTAL_MT- MAXTIME [X] cycles. This value also indicates the 
maximum number of processor cycles that can elapse before a 
thread that is ready to execute is actually executed because 
execution thread selector 12 0 selects priority thread PT as 
execution thread ET, if priority thread PT is not blocked. 
[0021] In some embodiments of the present invention, a thread 
can be assigned a maxtime value of zero. Threads with a maxtime 
value of zero are never selected as priority thread PT but may be 
executed when priority thread PT is blocked. Fig. 3 is a block 
diagram of a priority thread selector 3 00 that supports maxtime 
values of zero. Because priority thread selector 300 is very 
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similar to priority thread selector 200, the same reference 
numerals are used for components that are unchanged. Thus, 
priority thread selector 300 includes an internal thread counter 
310, maxtime registers 220, counter 230, a comparator 340 and a 
priority thread register 350. Internal thread counter 310 is a 
modulo N counter that provides an internal thread value ITV to 
maxtime registers 320 and priority thread register 350. Internal 
thread counter 310 can be incremented by comparator 340. Maxtime 
registers 320 provide maxtime value MAXTIME [ITV] to comparator 
340. 

[0022] Comparator 340 also compares maxtime value MAXTIME [ITV] 
to count value COUNT from counter 230. When count value COUNT is 
equal to maxtime value MAXTIME [ITV] comparator 340 resets counter 
230 and increments internal thread counter 310. However, 
comparator 340 also determines whether maxtime value MAXTIME [ITV] 
is equal to zero. When maxtime value MAXTIME [ITV] is equal to 
zero, comparator 340 increments internal thread counter 310 so 
that thread ITV, which has a maxtime value of zero can not become 
priority thread PT. When maxtime value MAXTIME [ITV] is not equal 
to zero, comparator 340 causes priority thread register 310 to 
store internal thread value ITV as priority thread value PTV. 

[0023] APPENDIX I provides another embodiment of a priority 
thread selector in accordance with the present invention 
implemented in pseudocode. One skilled in the art can easily 
convert the pseudocode to a hardware definition language such as 
VHDL or Verilog to create a priority thread selector in 
accordance with the present invention. 

[0024] As stated above, execution thread selector 120 (Fig. 
1) , receives priority thread value PTV and generates execution 
thread value ETV. The function of execution thread selector 120 
is governed by two basic rules. First, when thread PTV, i.e. 
priority thread PT, is not blocked then execution thread value 
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ETV is set equal to priority thread value PTV so that the 
execution unit (not shown) executes priority thread PT. If 
priority thread PT is blocked, then select a non-priority thread, 
which is not blocked, as execution thread ET and output the 
selected thread value as execution thread value ETV. 
[0025] The exact method of selecting a non-priority thread as 
execution thread ET varies among different embodiments of the 
present invention. For example, some embodiments may randomly 
select an unblocked non-priority thread as execution thread ET. 
Other embodiments may try to select the next closest unblocked 
thread relative to the priority thread as the execution thread. 
For example, these embodiments would check threads (PTV+1 MOD N) 
then thread (PTV+2 MOD N) etc. to find the next unblocked thread, 
which would be selected as the execution thread. 

[0026] Based on the two basic rules, various conditions could 
cause a new thread to be selected as execution thread ET. One 
condition is when priority thread PT was blocked but becomes 
unblocked. In this situation priority thread PT should be 
selected as execution thread ET. Another condition is if a new 
priority thread is selected. If the new priority thread is not 
blocked, execution thread selector 120 should select the new 
priority thread as the execution thread. If the new priority 
thread is blocked, execution thread selector 12 0 can either keep 
the current execution thread as the execution thread or select a 
new execution thread based on the new priority thread value. If 
the current execution thread becomes blocked, then execution 
thread selector must select a new execution thread. The exact 
method of selecting a new execution thread in these situations 
may differ between different embodiments. 

[0027] Fig. 4 is a simplified block diagram of an execution 
thread selector 400. Execution thread selector 400 includes an 
execution thread register 410, a comparator 420, a thread block 
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checker 430 and a controller 440. Execution thread register 410 
is controlled by controller 440 and provides execution thread 
value ETV. Comparator 42 0 compares priority thread value PTV and 
execution thread value ETV and provides a comparison result CR to 
controller 440. Thread block checker 430 determines whether 
threads are blocked or unblocked and provides block values 
BLOCK [0 : (N-l) ] for the active threads to controller 440. As used 
herein block value BLOCK [X], is associated with thread X. If 
block value BLOCK [X] is equal to 1, then thread X is blocked. If 
block value BLOCK [X] is equal to 0, then thread X is not blocked. 
[0028] Controller 440 follows the two basic rules given above 
to select a new execution thread value NETV when needed and 
writes new execution thread value NETV into execution thread 
register 410. 

[0029] Controller 440 can be implemented using a state machine 
500 as illustrated in Fig. 5. State machine 500 includes three 
states: executing priority thread state E_PT, executing a non- 
priority thread state EJSIPT, and finding an unblocked thread 
state FUBT. 

[0030] Executing priority thread state E_PT has four 
transition arrows 510, 520, 530, and 540. Transition arrow 510 
which returns to Executing priority thread state E_PT is 
triggered under the conditions that priority thread value PTV is 
equal to execution thread value ETV and that block value 
BLOCK [ETV] is equal to 0 . No actions are taken with transition 
arrow 510. Transition arrow 520 which also returns to Executing 
priority thread state E_PT is triggered under the conditions that 
priority thread value PTV is not equal to execution thread value 
ETV and that block value BLOCK [PTV] is equal to 0. When 
transition arrow 520 is triggered new execution thread value NETV 
is set to be equal to priority thread value PTV and stored in 
execution thread register 410 (Fig. 4) . Transition arrow 530 
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which causes a transition to executing non-priority thread state 
E_NPT is triggered under the conditions that priority thread 
value PTV is not equal to execution thread value ETV and that 
block value BL0CK[PTV] is equal to 1. When transition arrow 520 
is triggered, no actions are taken except for the transition to 
executing non-priority thread state E_NPT. Transition arrow 540 
which causes a transition to find unblocked thread state FUBT is 
triggered under the conditions that that block value BLOCK [ETV] 
is equal to 1. When transition arrow 520 is triggered, no 
actions are taken except for the transition to find unblocked 
thread state FUBT. 

[0031] In find unblocked thread state FUBT, controller 440 
finds an unblocked thread. The exact method of finding an 
unblocked thread may vary. For the embodiment of Fig. 4 and 5, 
an internal thread value ITV is set equal to execution thread 
value ETV. Then, ITV is incremented modularly by 1 until an 
unblocked thread is found. Find unblocked thread state FUBT has 
a single transition arrow 580 to executing non-priority thread 
state E_NPT. Transition arrow 580 is triggered as soon as an 
unblocked thread is found. When transition arrow 580 is 
triggered, new execution thread value NETV is set to be equal to 
internal thread value ITV and stored in execution thread register 
410 (Fig. 4) . 

[0032] Executing non-priority thread state E_NPT has three 
transition arrows 550, 560, and 570. Transition arrow 550 which 
returns to executing non-priority thread state E_NPT is triggered 
under the conditions that block value BLOCK [ETV] is equal to zero 
and block value BLOCK [PTV] is equal to 1 . No actions are taken 
with transition arrow 550. Transition arrow 560 which causes a 
transition to executing priority thread state E_PT is triggered 
under the conditions that block value BLOCK [PTV] is equal to 0. 
When transition arrow 560 is triggered, new execution thread 
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value NETV is set to be equal to priority thread value PTV and 
stored in execution thread register 410 (Fig. 4) . Transition 
arrow 570 which causes a transition to find unblocked thread 
state FUBT is triggered under the conditions that that block 
value BLOCK [ETV] is equal to 1. When transition arrow 570 is 
triggered, no actions are taken except for the transition to find 
unblocked thread state FUBT. 

[0033] APPENDIX II provides another embodiment of an execution 
thread selector in accordance with the present invention 
implemented in pseudocode. Furthermore, APPENDIX III provides 
another embodiment of an execution thread selector in accordance 
with the present invention implemented in pseudocode. One 
skilled in the art can easily convert the pseudocode to a 
hardware definition language such as VHDL or Verilog to create a 
execution thread selector in accordance with the present 
invention. 

[0034] In the various embodiments of this invention, novel 
structures and methods have been described to fairly allocate 
processor cycles to various active threads. The various 
embodiments of the structures and methods of this invention that 
are described above are illustrative only of the principles of 
this invention and are not intended to limit the scope of the 
invention to the particular embodiments described. For example, 
in view of this disclosure, those skilled in the art can define 
other priority thread selectors, execution thread selectors, 
state machines, controllers, comparators, maxtime registers, 
thread block checkers, and so forth, and use these alternative 
features to create a method or system according to the principles 
of this invention. Thus, the invention is limited only by the 
following claims. 
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APPENDIX I 

Copyright (c) 2002 Infineon Technologies N.A. Corp. 

All Rights Reserved 



Definitions : 

N active threads (Numbered 0 to N-l) 
Maxtime[X] is the maxtime for thread X. 
PTV=the priority thread value, (i.e. 0 to N-l) 

(priority thread starts with Thread 0) . 



PTV=0; "set priority thread equal to thread 0" 
ITV=PTV; "I TV is an internal variable for PTV. ITV is used 
to check whether a thread has a Maxtime of 0 without 
changing PTV, which may interfere with the execution 
thread selector" 

START 

Count=0; "set counter equal to 0" 
While Count <=Maxtime (ITV) 
{ Count =Count+l } 

"count until maxtime of the priority thread is reached" 
ITV=(ITV+1) MOD N; "increment the internal thread number 
(modularly) 

While Maxtime (ITV) =0 
{ITV=(ITV+1) MOD N} 

"Check if maxtime of thread PT is set to 0 if so skip the 
thread" 

PTV=ITV; 
goto START; 
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APPENDIX II 

Copyright (c) 2002 Infineon Technologies N.A. Corp. 

All Rights Reserved 

Definitions : 

N active threads (Numbered 0 to N-l) 
Maxtime [X] is the maxtime for thread X. 
PTV=the priority thread value, (i.e. 0 to N-l) 
ETV=the execution thread value, (i.e. 0 to N-l) 
BLOCK [X] indicates whether thread X is blocked. A value of 1 
means blocked, 0 means not 
blocked 



ETV=PTV; 
START : 

E_PT: "State of executing the priority thread" 
While (PTV=ETV and BLOCK [ETV] =0) {} 

"Execute thread ETV as long as ETV is the priority thread 
and unblocked" 

If ((PTV != ETV) and (BLOCK [PTV] =0 then ETV=PTV goto state 

E_PT: 

"New priority thread and it is unblocked so change ETV to 

PTV. 

IF ((PTV!=ETV) and (BLOCK [PTV] =1) then got E_NPT : 

"New priority thread but it is blocked so go to state 
E__NPT (i.e. execut ing 

non-priority thread" 
If BLOCK[ETV]=l then 

ITV=ETV; "I TV is an internal thread value used to find the 
next unblocked thread 

While BLOCK [ITV] =1 

{ITV=(ITV+1) MOD N} 
ETV=ITV; 

" thread ETV became blocked but the priority thread is 
still blocked so find 

an unblocked thread to execute" 

goto state E_NPT "goto the state of executing a non- 
priority thread" 

EJtfPT: "state of executing a non-priority thread" 
While ( (BLOCK [PTV] =1) and (BLOCK [ETV] =0 ) ) {} 

"Execute the thread ETV until the priority thread becomes 
unblocked or thread ETV 

becomes blocked" 
If (BLOCK [PTV] =0) ETV=PTV goto state E__PT; 

"priority thread became unblocked so change ETV to PTV and 
go to state E_PT i.e. executing priority thread" 
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Elseif (BLOCK [ETV] =1) then 
ITV=ETV; 

While BLOCK [ITV) =1 

{ITV=(ITV+1) MOD N} 
ETV=ITV 

"thread ETV became blocked -but thread PTV is still blocked 
so find an unblocked thread" 

goto E_NPT "goto the state of executing a non-priority 
thread" 
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APPENDIX III 

Copyright (c) 2 002 Infineon Technologies N.A. Corp. 

All Rights Reserved 

Definitions : 

N active threads (Numbered 0 to N-l) 
Maxtime[X] is the maxtime for thread X. 
PTV=the priority thread value, (i.e. 0 to N-l) 
ETV=the execution thread value, (i.e. 0 to N-l) 
BLOCK [X] indicates whether thread X is blocked. A value of 1 
means blocked, 0 means not 
blocked 

ETV=PTV; 
START : 

E_PT: "State of executing the priority thread" 
While (PTV=ETV and BLOCK [ETV] =0 ) {} 

"Execute thread ET as long as ET is the priority thread 
and unblocked" 
If PTV!=ETV then ETV=PTV goto E__PT : 

"New priority thread so change ET to PT. 
If BLOCK [ETV] =1 then 
ITV=ETV 

While BLOCK [I TV] =1 

{ITV=(ITV+1) MOD N} 

"thread ET became blocked but the priority thread is 
still blocked so find an unblocked thread to execute" 
ETV=ITV 
goto E_NPT 

"goto the state of executing a non-priority thread" 

E_NPT: "state of executing a non-priority thread" 
While ( (BLOCK [PTV] =1) and (BLOCK [ETV] =0) ) {} 

"Execute the thread ET until the priority thread becomes 
unblocked or thread ET becomes blocked" 
If (BLOCK [PTV] =0) ETV=PTV goto E_PT; 

"priority thread became unblocked so change ET to PT and 
go to state E_PT i.e. executing priority thread" 
If (BLOCK [ETV] =1) then 
ITV-ETV 

While BLOCK [ITV]=1 

{lTV=(ITV+l) MOD N} 
ETV=ITV 

"thread ET became blocked but thread PT is still 
blocked so find an unblocked thread" 
goto E_NPT 

"goto the state of executing a non-priority thread" 
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